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METHOD AND APPARATUS FOR DYNAMIC ing advertisements to viewers that have been more selec- 

DISTRIBUTION OF CONTROLLED AND tively tailored so as to more effectively capture the viewers 

ADDITIONAL SELECTIVE OVERLAYS IN A attention. Furthermore, there is a need for methods of 

STREAMING MEDIA determining, in real time, viewer preferences such that 

5 programming may be dynamically tailored to be more 

CROSS REFERENCE TO RELATED pleasing to the viewer. 

APPLICATIONS Therefore, it would be advantageous to have a method and 

The present invention is related to applications entitled apparatus for allowing customization of programming by a 

METHOD AND APPARATUS FOR USER- content provider. 

CONTROLLED SELECTIVE OVERLAY IN A STREAM- 10 
ING MEDIA, Ser. No. 09/409,594; and METHOD AND 

APPARATUS FOR DYNAMIC TARGETING OF The present invention provides a method and apparatus 

STREAMING MEDIA USING STATISTICAL DATA, Ser. for providing a tailored content stream to respective clients 

No. 09/409,601; all of which are filed even date hereof, from a server. A client profile is generated for each of the 

assigned to the same assignee, and incorporated herein by respective clients. From a plurality of related streams, 

reference. streams are selected to send to each respective client based 

on the respective client profile. Each respective client is sent 

BACKGROUND OF THE INVENTION only the respective selected streams for the client 



SUMMARY OF THE INVENTION 



BRIEF DESCRIPTION OF THE DRAWINGS 



1. Technical Field 20 
The present invention relates to the field of computer 

software and, more particularly, to methods of controlling The novel features believed characteristic of the invention 

and providing additional selective overlays in a streaming are set forth in the appended claims. The invention itself, 

media. however, as well as a preferred mode of use, further objec- 

2. Description of Related Art 25 lives and advantages thereof, will best be understood by 

j . . , t* j 4. «. * i » • reference to the following detailed description of an illus- 

Internet, also referred to as an internetwork , in com- A . , , , . . A . . Al xl 

. .. . r . t -i , trative embodiment when read in conmnction with the 

munications is a set of computer networks, possibly , u J 

i* »*i .. i i i r r I, . i ii accompanying drawings, wherein: 

dissimilar, joined together by means or gateways that handle r J & & 

data transfer and the conversion of messages from the FIG - 1 is a diagram of a distributed data processing 

sending network to the protocols used by the receiving 30 s y stem in whlch the P resent invention may be implemented 

network (with packets if necessary). When capitalized, the in accordance with a preferred embodiment of the present 

term "Internet" refers to the collection of networks and invention; 

gateways that use the TCP/IP suite of protocols. FIG. 2 is a block diagram of a data processing system, 

The Internet has become a cultural fixture as a source of which ma Y be implemented as a server system is depicted in 

both information and entertainment. Many businesses are accordance with the present invention; 

creating Internet sites as an integral part of their marketing FIG. 3 is a block diagram of a data processing system in 

efforts, informing consumers of the products or services which the present invention may be implemented; 

offered by the business or providing other information FIG. 4 is a block diagram broadly illustrating the process 

seeking to engender brand loyalty. 4Q 0 f the present invention; 

However, currently, the Internet has not reached the level FIG 5 i s a block diagram of functional components used 

of popular use encountered by more traditional media m the selection of media streams depicted in accordance 

sources such as television. Information from these more w j m me present invention; 

traditional media is typically broadcast in mass often too FIG. 6 is a diagram illustrating an example display 

many people who have no interest in the information. 45 depicted in accordance with a preferred embo diment of the 

Because, for any individual, so much of the information is Dresen t invention- 

of little or no interest, much wanted information is lost in the _ A ,. „ , 

information overflow from unwanted sources. Even the FIGS 7A-7D are diagrams illustrating data structures 

T . 4. nu u -a- ' 1 * a ' c contained within data streams sent to a client depicted in 

Internet, although providing more specialized information , . , t „ * 

.< a- a * a a * -i • ^ +• ^ accordance with a preferred embodiment of the present 

than other media, does not provide and tailor information tor r n • 

• a- -a i > * * invention; 

individual consumer s taste. ' 

t-, .< , A .,. t i- A , u T , . . FIG. 8 is a flowchart of a process used to process data 

Furthermore, traditional media, and even the Internet in , . , r . , r , « «. 

some respects, lack methods to specifically target advertise- ^ s jjjgj ^ ' embodlment 

ments to specific individual viewers. Additionally, methods 0 * e P resent inventlon > 

of determining the viewing tastes of and gathering feedback 55 FIG ' 9 is a flowchart of a P rocess for generating CRC 

regarding programming preferences from individual viewers values for use in synchronizing data streams depicted in 

is crude at best. The best methods currently available merely accordance with a preferred embodiment of the present 

target programming and advertising to particular demo- invention; 

graphics based on rough statistics of what kind of individual FIG. 10 is a flowchart of a process for synchronizing data 

is likely to be enjoy a particular program type. Furthermore, 60 streams using CRC data depicted in accordance with a 

presently, methods for controlling the media delivered to preferred embodiment of the present invention; 

viewers does not allow for fine tuning to cater to each FIG. 11 is a flowchart of a process for filtering data 

individual. depicted in accordance with a preferred embodiment of the 

Therefore, there is a need to provide methods for more present invention; 

selectively controlling the media streams delivered to indi- 65 FIG. 12 is a flowchart of a process to customize a program 

viduals such that greater viewer satisfaction is achieved. for a user depicted in accordance with a preferred embodi- 

Additionally, there is a need to provide methods for provid- ment of the present invention; 
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FIG. 13 is a flowchart of a process for retrieving user 
selection information depicted in accordance with a pre- 
ferred embodiment of the present invention; and 

FIG. 14 is a flowchart of a process for creating a profile 
depicted in accordance with a preferred embodiment of the 
present invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

With reference now to the figures and in particular with 
reference to FIG. 1, a diagram of a distributed data process- 
ing system in which the present invention may be imple- 
mented is depicted in accordance with a preferred embodi- 
ment of the present invention. Distributed data processing 
system 100 contains network 102, which is the medium used 
to provide communications links between various devices 
and computers connected within distributed data processing 
system 100. Network 102 may include permanent 
connections, such as wire or fiber optic cables, or temporary 
connections made through telephone connections. 

In the depicted example, server system 104 is connected 
to network 102, along with storage unit 106. Server system 
104 may contain one or more server computers for providing 
data streaming. For example, a server may be used to 
administer and control data streams while another server 
within server system 104 is employed to originate resource 
data streams to clients. The information in these data streams 
may be stored within server system 104 or on a remote 
storage device, such as storage device 106. In addition, 
clients 108, 110 and 112 are also connected to network 102. 
These clients, 108, 110 and 112, may be, for example, 
without limitation, personal computers, set top boxes, web 
TV units, or any other hardware unit for receiving data 
streams. Clients 108, 110 and 112 are clients to server 
system 104. In the depicted example, server system 104 
provides data streams to clients 108-112. Distributed data 
processing system 100 may include additional servers, 
clients, and other devices not shown. 

Clients 108, 110, and 112 include mechanisms for mixing 
and filtering data streams received from server system 104 
or other server systems not shown. These mechanisms may 
be implemented in hardware, software, firmware, or some 
combination thereof in the depicted examples. 

Distributed data processing system 100 may be, for 
example, the Internet, with network 102 representing a 
worldwide collection of networks and gateways that use the 
TCP/IP suite of protocols to communicate with one another. 
At the heart of the Internet is a backbone of high-speed data 
communication lines between major nodes or host comput- 
ers consisting of thousands of commercial, government, 
education, and other computer systems that route data and 
messages. 

Another implementation for network 102 is as a broad- 
band network, also referred to as a broadband integrated 
services digital network (BISDN). In such a network, broad- 
band services typically provide channels capable of support- 
ing data transmission rates of greater than 1.5 Mbps or a 
primary rate in integrated services digital network (ISDN), 
Tl, or DS1. In broadband system, the type of transfer mode 
typically is a synchronous transfer mode (ATM) with the use 
of synchronous optical network (SONET) and intelligent 
network (IN) technologies as providing the framework for 
ISDN. In such a network, information including voice, data, 
video, and audio are transferred through the network to 
various clients. 

Further, network 102 also may be a cable communications 
system depending on the implementation. Of course, dis- 



L0,492 Bl 

4 

tributed data processing system 100 also may be imple- 
mented as a number of different types of networks such as, 
for example, an intranet or a local area network. FIG. 1 is 
intended as an example and not as an architectural limitation 

5 for the processes of the present invention. 

Referring to FIG. 2, a block diagram of a data processing 
system, which may be implemented as a server system, such 
as server system 104 in FIG. 1, is depicted in accordance 
with the present invention. Data processing system 200 may 

10 be employed as a video server or other application server 
within a server system. 

Data processing system 200 may be a symmetric multi- 
processor (SMP) system including a plurality of processors 
202 and 204 connected to system bus 206. Alternatively, a 

15 single processor system may be employed. Also connected 
to system bus 206 is memory controller/cache 208, which 
provides an interface to local memory 209. I/O bus bridge 
210 is connected to system bus 206 and provides an interface 
to I/O bus 212. Memory controller/cache 208 and I/O bus 

20 bridge 210 may be integrated as depicted. 

Peripheral component interconnect (PCI) bus bridge 214 
connected to I/O bus 212 provides an interface to PCI local 
bus 216. A number of modems 218-220 may be connected 
to PCI bus 216. Typical PCI bus implementations will 

25 support four PCI expansion slots or add-in connectors. 
Communications links to network computers 108-112 in 
FIG. 1 may be provided through modem 218 and network 
adapter 220 connected to PCI local bus 216 through add-in 

3q boards. 

Additional PCI bus bridges 222 and 224 provide inter- 
faces for additional PCI buses 226 and 228, from which 
additional modems or network adapters may be supported. 
In this manner, server 200 allows connections to multiple 

35 network computers. A memory mapped graphics adapter 
230 and hard disk 232 may also be connected to I/O bus 212 
as depicted, either directly or indirectly. 

Those of ordinary skill in the art will appreciate that the 
hardware depicted in FIG. 2 may vary. For example, other 

40 peripheral devices, such as optical disk drives and the like, 
also may be used in addition to or in place of the hardware 
depicted. The depicted example is not meant to imply 
architectural limitations with respect to the present inven- 
tion. 

45 The data processing system depicted in FIG. 2 may be, for 
example, an IBM RS/6000, a product of International Busi- 
ness Machines Corporation in Armonk, N.Y., running the 
Advanced Interactive Executive (AIX) operating system. 
With reference now to FIG. 3, a block diagram of a data 

50 processing system in which the present invention may be 
implemented is illustrated. Data processing system 300 is an 
example of a computer. Data processing system 300 
employs a peripheral component interconnect (PCI) local 
bus architecture. Although the depicted example employs a 

55 PCI bus, other bus architectures, such as Micro Channel and 
ISA, may be used. Processor 302 and main memory 304 are 
connected to PCI local bus 306 through PCI bridge 308. PCI 
bridge 308 may also include an integrated memory control- 
ler and cache memory for processor 302. Additional con- 

60 nections to PCI local bus 306 may be made through direct 
component interconnection or through add-in boards. In the 
depicted example, local area network (LAN) adapter 310, 
SCSI host bus adapter 312, and expansion bus interface 314 
are connected to PCI local bus 306 by direct component 

65 connection. In contrast, audio adapter 316, graphics adapter 
318, and audio/video adapter (A/V) 319 are connected to 
PCI local bus 306 by add-in boards inserted into expansion 
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slots. Expansion bus interface 314 provides a connection for 
a keyboard and mouse adapter 320, modem 322, and addi- 
tional memory 324. In the depicted example, SCSI host bus 
adapter 312 provides a connection for hard disk drive 326, 
tape drive 328, CD-ROM drive 330, and digital video disc 
read only memory drive (DVD-ROM) 332. Typical PCI 
local bus implementations will support three or four PCI 
expansion slots or add-in connectors. 

An operating system runs on processor 302 and is used to 
coordinate and provide control of various components 
within data processing system 300 in FIG. 3. The operating 
system may be a commercially available operating system, 
such as OS/2, which is available from International Business 
Machines Corporation. "OS/2" is a trademark of Interna- 
tional Business Machines Corporation. An object oriented 
programming system, such as Java, may run in conjunction 
with the operating system, providing calls to the operating 
system from Java programs or applications executing on 
data processing system 300. Instructions for the operating 
system, the object-oriented operating system, and applica- 
tions or programs are located on a storage device, such as 
hard disk drive 326, and may be loaded into main memory 
304 for execution by processor 302. 

Those of ordinary skill in the art will appreciate that the 
hardware in FIG. 3 may vary depending on the implemen- 
tation. For example, other peripheral devices, such as optical 
disk drives and the like, may be used in addition to or in 
place of the hardware depicted in FIG. 3. The depicted 
example is not meant to imply architectural limitations with 
respect to the present invention. For example, the processes 
of the present invention may be applied to multiprocessor 
data processing systems. Additionally, data processing sys- 
tem 300 may take the form of a notebook computer or a 
personal digital assistant (PDA). Further, the data processing 
system may be, for example, without limitations, a televi- 
sion or settop cable box containing appropriate hardware 
and software for implementing processes of the present 
invention. 

The present invention provides a method, apparatus, and 
computer implemented instructions for decreasing band- 
width usage and for providing increased client customiza- 
tion of programs or events. The mechanism of the present 
invention is directed towards tailoring a multimedia presen- 
tation on a multimedia data processing system. This is 
accomplished by breaking up a program or event into 
different data streams for different audio and video compo- 
nents. Additional optional data streams may be added to 
allow for customization of the program or event. A data 
processing system may receive a set of video and audio 
streams associated with a program or event. These data 
streams may be selectively presented based on user input. 
Depending on the user input, some portions of the video and 
audio data streams may be presented while other data 
streams are unpresented. Further, user input may selectively 
place a video stream on a display in different locations. Also, 
information streams containing text and/or graphics may be 
received and selectively displayed in association with the 
presentation of the program or event. The combination of 
these data streams at the user site provides for customization 
without requiring broadcasting of multiple versions of an 
event to viewers. 

By allowing a viewer to customize a program or event, 
bandwidth usage may be reduced because program origina- 
tors do not have to broadcast multiple versions of a program 
or event for different geographical regions or different 
viewer basis. 

More specifically, the present invention provides a 
mechanism to allow a content provider to provide programs 
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or events to users in the form of multiple data streams. The 
mechanism of the present invention allows a content pro- 
vider to control data streams sent to a user based on input 
and other data received from a user. The user information 
may take the form of a filter profile, which contains infor- 
mation about selections made by a user. The filter profile 
also may contain other information such as location and 
demographic information that may or may not be used in 
tailoring and customizing a program for a user. The present 
invention also provides a mechanism for presenting data 
streams on a user system that the content provider feels is 
important for the user to see or hear even though the user 
may not have selected these data streams. For example, an 
embedded command may be included in the data streams 
sent to the user to cause a multimedia system to present a 
data stream that the content provider wants presented even 
though the user may not have selected that particular data 
stream. 

Turning now to FIG. 4, there is shown a block diagram 
broadly illustrating the process of the present invention. A 
client 400, such as data processing system 300 in FIG. 3, 
sends a request 402 for programming content to an origi- 
nating server 404. Originating server 404 is a data process- 
ing system, such as data processing system 200 in FIG. 2, 
and is the host for the programming content requested by 
client 400. Originating server 404 sends the requested pro- 
gramming as a set of data streams 406 back to client 400. 
Data streams 406, may be used to present programming or 
events to a user at client 402. Furthermore, data streams 406 
may comprise one or more video stream components, one or 
more information stream components, and one or more 
audio stream components. 

Client 400 and originating server 404 have been described 
and illustrated in FIG. 4 as though they are directly con- 
nected. However, client 402 and originating server 404 are 
preferably part of a distributed data processing system such 
as distributed data processing system 100 in FIG. 1 and are 
linked together via a network, such as network 102. 

The environment illustrated in FIG. 4 may be a one way 
environment or a two way environment. In a one way 
environment, the server sends data to the client, but does not 
receive data from the client. In this case, a client receives a 
full range of data streams from the server. A filter is used to 
allow data streams selected by the user to be presented while 
non selected data streams remain unexposed to the user. A 
profile about the user may be created based on the user input. 
This profile contains customization information based on 
user input as well as information about the user at the client. 
This information may include, for example, an identification 
of preferences, data stream selections, as well as circum- 
stantial information, such as location. 

In a two way environment, the server sends data to the 
client and the client sends data back to the server. In such an 
environment the server for the content provider sends only 
selected data streams to the client based on a profile received 
from the client. 

Turning next to FIG. 5, a block diagram of functional 
components used in the selection of media streams in 
accordance with the present invention is depicted. In this 
example, client 500 includes a data stream processing sys- 
tem 502 to receive data streams 504 from a server 506 
through network 508 for output to output system 510. Server 
506 in this example is a source for content from a content 
provider. The selection of data streams received from net- 
work 504 are controlled through user control 512, which 
controls data stream processing system 502. User control 
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512 is used to manipulate or adjust filter 514, which filters 
data streams 504 in data stream processing system 502 to 
selectively present data streams 504 on output system 510. 
Also present in data streaming processing system 502 is a 
profile 515, which may be generated based on user prefer- 
ence setting, data stream selections, and filters applied. For 
example, profile 515 may include information identifying 
current volume settings at client 500. A low volume setting 
below some threshold may indicate that the users are not 
really watching or paying attention to the event. Profile 515 
also may include other information, such as, for example, 
the geographic location of client 500. Multiple data streams 
may be received from network 508 through connection 504. 
These data streams may be, for example, audio, video, text, 
graphics, or other information that may be displayed through 
output system 510 to a user of client 500. Selection filtering 
of data streams from network 508 by data stream processing 
system 502 are controlled through user control 512. The 
selected data stream or selected portions of data streams are 
displayed to user through output system 510, which may be 
used to drive displays and audio output devices, such as a 
high definition television or speakers. Further, video streams 
may be configured for parameters, such as, for example, 
opacity and scaling. 

With reference now to FIG. 6, a diagram illustrating an 
example display is depicted in accordance with a preferred 
embodiment of the present invention. In this example, a 
presentation system 600 is presented with a display unit 602, 
audio sources 604, 606, and 608. Presentation system 600 is 
the part of a client through which the user sees and hears 
programs. In this example, audio source 604 is a left speaker 
while audio source 608 is a right speaker. Audio source 606 
is the center speaker in this example. The video 610 is 
displayed in display 602 with text box 612, text box 614, and 
video 616. Video 610 is the primary data stream in this 
example with text box 612 and text box 614 being overlaid 
over video 610. 

Text box 612 and text box 614 are generated from two 
data streams in this example. Text box 612 is a stationary 
text box, which may be used to provide information, such as 
statistics about the program, upcoming programs, or any 
other information the user may select. Text box 614 in this 
example is a "pop-up," which may be used to provide 
information about a particular object or person in video 610. 

Additionally, the data packets in text box 614 may include 
data to reposition text box 614 to follow a particular object 
or person. Video 616 is displayed using another data stream 
to provide additional viewing for the user. For example, 
video 616 may provide different perspectives in the program 
or may illustrate scenes not currently displayed within video 
610. Initially, the user may select various audio streams for 
feed through 604, 606, and 608. For example, if the pro- 
gramming being displayed is a sporting event, the user might 
select a particular player and have audio information about 
that player played over 608 or have direct feeds from a 
microphone located on the player played through 604. 

By way of example, consider a football game being 
broadcast across the Internet or a broadband network. The 
end user is able to select from and mix several audio streams. 
For example, the quarterback microphone of either team, the 
coach's microphone of either team, and/or the announcers, 
of which, there could be several (e.g., John Madden, Phil 
Simms, Howie Long, Bruce Beadle, Michael Paolini, etc.). 
In this manner, the user is able to tune-out (deselect) John 
Madden if they find him offensive. The user might instead 
choose to listen to the Quarterback microphone of the 49er's 
(or the opposing team, or another announcer of their choice, 
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or to listen in another language entirely) without having to 
change the channel/coverage. 

Carrying the football example further, with the present 
invention, it is possible to have a separate audio track for 

5 viewers that are new to the sport. This separate audio track 
would explain the rules of the game and what is happening 
in additional detail. It would also explain the technical 
jargon particular to football. The user may choose to have 
this additional information presented as a text stream. 

10 In yet another example of the use of the present invention, 
continuing with the football theme, the user could place 
team A's player voices on the right channels with team B's 
player voices on the left channels and the announcers' 
voices on the rear channels. Furthermore, the user could 
select the player with the ball such that this player's voice is 
always on the center channel. 

One primary data stream representing the video (which 
does not change no matter which audio overlay streams are 
selected), and many small add-on data streams representing 

2Q audio or video overlays may be used to present the program. 
These streams could be mixed together or assigned to 
channels (right, left, rear, center, etc.) and/or 3-D positional 
locations using the latest "Dolby Digital" from Dolby Labo- 
ratories and other similar technologies. In addition, the 

25 volume could be adjusted on a per-overlay basis. More 
information on technologies, such as "Dolby Digital" may 
be found in U.S. Pat. No. 5,912,976. 

With respect to video overlays, several video overlays can 
also be streamed and selected in a manner similar to the 

30 audio streaming and mixed to "overlay" the final video. If, 
for example, the desired overlay was a balloon shaped 
pop-up at a certain video display position containing some 
text, then the additional overlay stream would not have to be 
video itself, but rather the information to create the overlay 

35 video. Therefore, the size of the data stream would be much, 
much smaller than a primary video stream. Additionally, 
unrelated information in addition to the data streams sleeted 
for an event, such as, for example, stock market data or news 
headlines also may be provided to the user. If, for example, 

40 the event or programming being viewed is that of a football 
game, it is possible to have a video overlay stream dedicated 
to displaying pop -up balloons with data, such as statistics on 
players in which these pop-up balloons may appear over the 
players themselves. Additionally, betting odds, other inter- 

45 esting facts about the players, or rules and information about 
events may be displayed in this manner. Another type of data 
stream may include embedded pictures of players with 
biographies tagged on as well. 

For other types of programming, other pop-up windows 

50 may be provided. For example, for a murder mystery show, 
pop-up windows giving clues about future events may be 
displayed or facts about actors, the script, or director also 
may be displayed in association with the program. 

In this manner, in the context of the football game 

55 example, it is possible to have video overlay streams dedi- 
cated to displaying pop -up balloon(s) with data such as: 
statistics on players (they very well might appear over the 
players themselves), betting odds, odd or interesting facts, 
information explaining what is happening and rules (for 

60 novices), a summary of different on-going sporting event 
data (such as scores and statistics from other games in 
progress), stock market data, and news headlines to provide 
but a few examples. Another stream type might contain 
embedded pictures of the players with bios tagged on as 

65 well. 

In another embodiment, it is possible to make the overlays 
selectable. That is to say that the user might do the equiva- 
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lent of "clicking" on one, to trigger additional overlay stream. Location field 730 may be used to identify the 

streams, or lock it in place. For example, selecting a player's location on the screen at which the data is to be displayed, 

"name overlay" might for example bring up an overlay with Duration field 732 may identify the amount of time the data 

that player's biography. In a one-way system, this could be is to be displayed. Z depth field 734 may be used to identify 

done by having an overlay channel which continually cycles 5 the depth or order in which the data is to be displayed 

through all the players biographies, and having the client relative to other video streams. The depth is used to deter- 

"select" the one of interest at the time of broadcast. mine the order in which video streams or overlays are 

A11 . . „ 11 1 , i i.j* displayed on the display. 

Additionally, the user could select between the different , f , , , _„ . . , r , , , 

• ,1 • I** j *i_ i_ i * ^ 1 r In the example, header 724 is an example of a header used 

options using their client and thus have a lot more control of for a ^ ^ m containi text tc / be dis { d as a 

the information they would like to see and hear during a 10 ^ ^ ^ ^ ^ fa ^ ^ ^ 

broadcast. 732 identifies how long the text is to be displayed while the 

Turning now to FIGS. 7A-7D, diagrams illustrating data z depth field 734 identifies where the text is to be located 

structures contained within data streams sent to a client are with respect to other video streams. Location field 730 

depicted in accordance with a preferred embodiment of the provides the xy location on the screen. In the text for display 

present invention. In FIG. 7A, a data packet 700 is shown in 15 in the pop -up would be found in the pay load. In this manner, 

which the data packet includes a header 702 and a payload a video overlay stream dedicated to displaying text, may be 

704. Header 702 contains information used in routing and used along with moving video data streams, 

handling data contained within payload 704 of data packet Turning now to FIG. 8, a flowchart of a process used to 

700. process data streams is depicted in accordance with a 

In FIG. 7B, an example of header information found 20 preferred embodiment of the present invention. To start, a 

within a data packet, such as data packet 700, is shown. In user selects Programming to be retrieved from a distributed 

+u . i t a me • 1 a T~n\ c utao u i database (step 800). Ihe user receives multiple video and 

this example, header 706 includes an ID field 708, a channel ' j- . ^ i.i 

c u-^ 1 ^ . j . £ tJ , t £ t j , audio streams corresponding to the selected program (step 

field 710, a position field 712, and a volume field 714. OA ~x , r . , . r 0 %a\ \u 

' r ' 802). Ihe user selects audio streams (step 804), either 

In this example, header 706 is a header identifying an 25 directly in real time or through the use of user defined 

audio packet. ID field 708 is used to identify the type of data configurations, and, if more than one audio stream is 

packet. Channel field 710 in this example may be used to selected (step 806), then the user configures the presentation 

identify the channel or channels in which the data packet is profile for the selected audio streams (step 808). For 

to be presented to the user. For example, channel field 710 example, if three audio streams are chosen, the user could 

may be used to identify channels such as those in a surround 30 configure the system to play one audio stream on the left 

system. The channels may be, in this example, right, left, channel, one audio stream on a center channel, and one 

rear, or center. Additionally, position field 712 also is audio stream on a right channel. Alternatively, the user could 

included such that three dimensional positional locations configure the presentation of the selected audio streams such 

using sound technologies such as Dolby Digital may be that the volume of one audio stream is louder than the 

employed. This positional information may provide a 35 volume of the other two audio streams, 

default positioning that may be altered by a user. Volume Next, the user selects, from the plurality of video streams 

field 714 is included to allow for adjusting the volume of the received, one or more video streams to be displayed (step 

data in this data packet relative to other data packets to allow 811). If more than one video stream is selected (step 814), 

for overlays or emphasis for different data streams. Other then the user configures the presentation of the multiple 

fields may be used in addition to or in place of fields shown 40 video streams (step 816). For example, one video stream 

in header 706 for presenting audio information. could be presented on the left side of the video display and 

In FIG. 7C, a header 716 is an example of header a second video stream could be presented on the right side 

information found in a video packet used in a video stream. of the video display. In another example, one video stream 

In this example, header 716 includes an ID field 718, a time might occupy the entire video display screen, while a second 

stamp field 720, and a CRC field 722. ID field 718 is used 45 video stream was placed in a smaller window within the first 

to identify the type of data contained within the packet, video stream. Also, video streams are configurable for such 

while time stamp 720 in this example is used for synchro- things as opacity and scaling, as well as other factors, 

nization purposes. CRC field 722 may be used for error Opacity is the semi-transparency as seen in menus overlaid 

checking or synchronization purposes depending upon the on an event in which the event can be sen through the menu, 

implementation. If CRC field 722 is used for synchroniza- 50 Scaling may be employed to size display of a video stream 

tion purposes, the CRC data is calculated for another data on a display device. 

stream and placed within this field prior to being transmitted Once the media streams are selected and configured by 

or broadcast to a viewer. The CRC data may be, for example, the user, the audio and video streams are synchronized to 

calculated for a frame or a portion of a frame in the other each other (step 818) and presented to the user in a user 

data stream. When this data stream and the other data stream 55 configured manner (step 820) with the process terminating 

are received, CRC data is calculated for a frame in the other thereafter. 

data stream. This calculated CRC data is compared with the With reference again to step 806, if more than one audio 

CRC data stored in CRC field 722. Matches between these stream is not selected, then the process proceeds to step 811 

CRC values are used to identify synchronization points as described above. With reference again to step 814, if more 

between the two data streams. 60 than one video stream is not selected, the process proceeds 

Next, in FIG. 7D, another example of a header used for to step 818 as described above, 

data packets in a video stream is illustrated. Header 724 Several mechanisms may be employed to synchronize the 

includes an ID field 726, a type field 728, a location field data streams. For example, a time stamp may be sent with 

730, a duration field 732, and a z depth field 734. ID field each packet of data in each media stream, then each selected 

726 is used to identify the data packet as containing video 65 data stream is synchronized to be presented to the user such 

data. Type field 728 in this example may be used to identify that data packets with identical time stamps are presented at 

the type of video, such as text, or a frame in a moving video the same time. 
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Each data stream also may contain a spike in the data that returning to step 1000. The present invention could be 
appears at a periodic rate. The spike in the data may be, for implemented via one-way or two-way communication 
example, a data packet that contains no video or audio. depending on the bandwidth of the network type in use. 
Further, each data stream contains a larger spike that appears Thus, the present invention provides a customized expe- 
at a longer periodic rate. For example, the shorter spike may 5 r i ence for a user. The present invention provides this dis- 
appear every 30 frames wherein the larger spike appears tomized experience by providing a number of different types 
every 10 seconds. The selected data streams may be syn- of data streams, audio and video, which are delivered to a 
chronized such that they are presented to the user such that c ii ent m which the client may select from these data streams 
the spikes appear in the data streams simultaneously. The t0 customize the program or event being viewed by the user, 
longer spike enables the system to resynchronize itself 10 Further, the present invention allows for decreasing the 
periodically if the data streams have become separated by a amount of bandwidth needed to provide customized pro- 
period of one or two smaller data spikes. gramming. This advantage is provided by sending data 

In a third method of synchronization, cyclic redundancy streams that may be selectively presented for a customized 

check (CRC) values. Synchronizing data streams using a program or event, rather than creating a new data stream for 

CRC data involves calculating CRC data for a first data 15 e ach desired customization of a program or event, 

stream and placing those calculated values in the headers of With reference now to FIG. 11, a flowchart of a process 

data packets in the second data stream. The CRC values are for filtering data is depicted in accordance with a preferred 

placed in data packets in the second data stream that should embodiment of the present invention. This process may be 

be synchronized with data packets in the first data stream. used in a system at tne user site to select and customize a 

Turning to FIG. 9, a flowchart of a process for generating 20 program. 

CRC values for use in synchronizing data streams is The process begins by receiving data streams (step 1100). 

depicted in accordance with a preferred embodiment of the Thereafter, a user selection is received for the data streams 

present invention. The process illustrated is used for video ( step 110 2). A determination is made as to whether addi- 

streams, but may be applied to other types of data streams. ^ tional user selections are to be made (step 1104). If more 

The process begins by selecting an unprocessed frame user selections are to be made, the process returns to step 

(step 900). This step selects the first unprocessed frame for 1102. Otherwise, a filter is adjusted based on the user 

content that will be transmitted as a data stream. A CRC selection (step 1106). This filter is used to select data streams 

value is then calculated for the frame (step 902). The CRC received from a content provider for presentation. A deter- 

value may be calculated for an entire frame or different ^ mination is then made as to whether an embedded command 

portions of the frame. For example, the CRC value may be is present in the data streams (step 1108). This step may 

based on the first five bytes of the frame, five bytes in the check data streams both solicited and unsolicited by the user, 

middle of the frame, and the last five bytes in the frame. Embedded commands may be used by the content provided 

Next, the portion of a second data stream that is to be to ensure that some data streams are presented to the user 
synchronized with this frame is identified (step 904). The 35 even though the user may not have selected these data 
CRC value is then placed into the header of a data packet for streams for presentation. For example, if an important news 
that portion of the data stream (step 906). A determination is event occurs, such as a dangerous storm, the content pro- 
then made as to whether additional unprocessed frames are vider will want to make sure that this information is pre- 
present for processing (step 908). If additional unprocessed sented to the user. Also, data streams containing advertising 
frames are present, the process returns to step 900. 4Q may be presented to the user without the user selecting these 
Otherwise, the process terminates. data streams. 

The process in FIG. 9 may be used when the data streams If an embedded command is present in a data stream, the 

are transmitted or broadcast. Alternatively, these processes filter is adjusted based on the embedded command (step 

may be initiated prior to transmitting or broadcasting a data 1110). The data stream are then filtered using the adjusted 

stream. In such a case, the CRC values may be stored and 45 filter (step 1112). The filtered data streams are then presented 

added to the second data stream when that data stream is (step 1114) with the process terminating thereafter. In this 

transmitted. manner selected data streams may be presented to the user 

Turning now to FIG. 10, a flowchart of a process for while unselected data streams are never presented to the 
synchronizing data streams using CRC data is depicted in user. With reference again to step 1108, if an embedded 
accordance with a preferred embodiment of the present 50 command is absent from the data stream, the process pro- 
invention. The processes illustrated in FIG. 9 may be imple- ceeds directly to step 1112 as described above, 
mented at the viewer site to synchronize incoming data Turning now to FIG. 12, a flowchart of a process to 
streams for presentation of a program or event. customize a program for a user is depicted in accordance 

The process begins by receiving data streams (step 1000). with a preferred embodiment of the present invention. This 

In step 1000, the data streams are received for presentation. 55 process may be used by a server or source for a content 

These data streams are placed in a buffer prior to presenta- provider to receive customization requests for a program 

tion (step 1002). A CRC value is calculated for a frame in the from various users. 

first data stream stored in the buffer (step 1004). Thereafter, The process begins by receiving a request for a program 

the calculated CRC value is compared to CRC values in the from a user (step 1200). This request may be, for example, 

second data stream stored in the buffer to identify a point in 60 the profile from the user system. This profile may include, 

the second data stream containing a matching CRC value for example, data streams selected by the user, filters used, 

(step 1006). In the depicted examples, CRC values are location information of the system, and even possibly demo - 

placed within headers in the second data stream at points graphic information for the user. The request is then parsed 

where the CRC value should match a calculated CRC value (step 1202). Data streams matching the requests are identi- 

from a portion of the first data stream. Thereafter, the first 65 fied (step 1204). These data streams include those selected 

and second data stream are presented at the matching or by the user, but also may include data streams selected by 

synchronization points (step 1008) with the process then the content provider based on the choice of data streams in 
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the request. These additional requests may be presented at 
the user system through embedded commands in the 
depicted examples. Thereafter, the data streams identified 
are transmitted to the user (step 1206) with the process 
terminating thereafter. 5 

With reference now to FIG. 13, a flowchart of a process 
for retrieving user selection information is depicted in 
accordance with a preferred embodiment of the present 
invention. This process may be used by a content provider 
to customize programming for a user without requiring the 10 
user to send requests to the content provider. 

The process begins by retrieving a profile from the user 
system (step 1300). Thereafter, data streams are identified 
based on the information from the profile (step 1302). These 
identified data streams are then transmitted to the user (step 15 
1304) with the process terminating thereafter. This collec- 
tion of profile information from a user system is performed 
in real time in the depicted examples. The information may 
be collected as user selections are made and preferences are 
set. Alternatively, the information may be received on a 20 
periodic basis depending on the implementation. In this 
manner, up to date profiles are obtained from which data 
streams may be identified for transmission to the user from 
which the information was received. The content is tailored 
based on current selections and preferences by users. This 25 
information is better than demographic information because 
different users may use a particular multimedia system. Of 
course, demographic information may be used in conjunc- 
tion with the profile information collected from users. 

30 

Turning now to FIG. 14, a flowchart of a process for 
creating a profile is depicted in accordance with a preferred 
embodiment of the present invention. The process begins by 
storing user selections of data streams and preferences for 
presentation (step 1400). Thereafter, filters applied by the 35 
user are stored (step 1402). A profile is created with the 
stored information (step 1404) with the process terminating 
thereafter. This profile also may include other information 
about the user, such as, for example, a location of the user 
system. 40 

By targeting streaming media using the mechanism of the 
present invention, the amount of bandwidth needed to trans- 
mit customized programming is reduced. Furthermore, the 
present invention allows for targeting of streaming media 
based on profile information, which increases the effective- 45 
ness of the information. Not only can the correct audience 
for the information be found, but the best mode of presen- 
tation of the information can also be found. Based on a 
profile, information may be presented in different forms that 
the client can easily understand. For example, a person 50 
might be a viewer watching a football game with a statistic 
filter turned on and a filter giving information about a 
particular team or player. Targeted advertisement has more 
of an impact because not only are they targeted for the 
football viewer (as are conventional advertisement 55 
methods), but also for a football fan that responds to 
numbers (information inferred from the statistics filter in use 
by the fan), and a football fan that is a fan of a team or player 
(again inferred from the filter in use). 

Also, by collecting profiles from clients, customer feed- 60 
back can be supplied to vendors supplying the streaming 
media. That is to say, the consumption of media can be 
measured in real time allowing dynamic reconfiguration of 
broadcast material. For example, if more clients are receiv- 
ing one media stream of a certain type more than others, 65 
then, perhaps, more variations of that type of stream should 
be made available. If more clients exist like factoids, then 
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more time should be spent finding weird facts about the 
subject of the programming. If more people listen to differ- 
ent audio streams than watch video overlays, then it is 
justified to invest more money for audio streams. 

Turning now to an example of the present invention in 
which the user profile is not provided directly via input or 
selection by a user. Consider, instead, a situation in which 
the user profile is created by the location of a user. For 
example, perhaps a person is driving in a car equipped with 
a global positioning system (GPS) such as The NorthStar 
System in which information on the current location is fed 
into the client as a filter preference. The parts of the map 
shown on a heads up display or an advertisement on an audio 
stream being received, using the present invention, may be 
based on the location as well as any other preferences. For 
example, a stream containing an advertisement for a restau- 
rant or other attraction may be sent to the client when the car 
is within a specified distance from the restaurant or attrac- 
tion. 

Thus, the present invention provides a method and appa- 
ratus for allowing user customization of a program as well 
as reducing bandwidth required to deliver customized pro- 
grams. By separating the broadcast of the programing to 
separate streams, media bandwidth in the broadcast medium 
is saved. For example, a television show has both sound and 
video in one stream. To broadcast a show in different 
languages, the same video is sent with different sound 
coupled to it. With separate streams of video and audio, one 
stream of video could support all the different audio streams. 
The "channel" could act like a filter choosing which audio 
stream to play along with the video. When X different 
language are supported by supplying an audio stream for 
each one and only one video stream, (X-l) times the size of 
the video is the savings in bandwidth. 

It should be noted, that although described with reference 
to use of the streams by one device, the streams can be used 
by multiple devices as well. Such modification to the present 
invention will be obvious to those skilled in the art upon 
reading this description of the invention. Furthermore, 
streams can be grouped together for the user to select which 
streams a device or devices will use. Also the streams are not 
limited to audio or video, but may include other types of 
information as well such as, for example, graphics and text. 

It is important to note that while the present invention has 
been described in the context of a fully functioning data 
processing system, those of ordinary skill in the art will 
appreciate that the processes of the present invention are 
capable of being distributed in the form of a computer 
readable medium of instructions and a variety of forms and 
that the present invention applies equally regardless of the 
particular type of signal bearing media actually used to carry 
out the distribution. Examples of computer readable media 
include recordable -type media such a floppy disc, a hard 
disk drive, a RAM, and CD-ROMs and transmission-type 
media such as digital and analog communications links. The 
description of the present invention has been presented for 
purposes of illustration and description, but is not intended 
to be exhaustive or limited to the invention in the form 
disclosed. Many modifications and variations will be appar- 
ent to those of ordinary skill in the art. It is important to note 
that while the present invention has been described primarily 
in terms of streaming media distributed through a network 
such as the Internet, the present invention, with appropriate 
modifications as will be obvious to those of ordinary skill in 
the art, may also be applied in other contexts such as in 
broadcast media such as conventional television and in other 
wireless communication systems employing such commu- 
nication channels as satellite and microwave transmissions. 
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Additionally, although the examples are implemented wherein the first instructions comprise: 

through the transmission of multiple data streams, additional fourth instructions for gathering inputs from a user at a 

data streams may be embedded within the main or primary client for a selected set of streams; 

data stream or streams. For example, buffering of frames fifth instructions for sending the inputs to the server; 

might be employed in which one frame out of every 31 5 and 

frames contains the additional content. These frames may be sixth instructions for deriving a filter from the set of 

buffered until the content is fully assembled and ready or inputs; 

triggered by some user input. wherein a client profile for a client developed for a prior 

Although the examples have been given in terms of a event is used to filter streams for a new event until new 

football game, other events such as movies or concerts 1Q inputs from the client indicate changes to the client 

would also be typical offerings. Also, although the examples profile are desired. 

have used location as a parameter, other client characteris- 10. The computer program product as recited in claim 9, 

tics such as machine capabilities can be used. The embodi- wherein the client profile is derived at least in part according 

ment was chosen and described in order to best explain the to client characteristics. 

principles of the invention, the practical application, and to 11. The computer program product as recited in claim 10, 

enable others of ordinary skill in the art to understand the 15 wherein the client characteristics comprises location, 

invention for various embodiments with various modifica- 12. The computer program product as recited in claim 10, 

tions as are suited to the particular use contemplated. wherein the client characteristics comprises machine capa- 

What is claimed is: bilities of the client. 

1. A method for providing a tailored content stream to 13. computer program product as recited in claim 12, 
respective clients from a server comprising the computer 20 wherein client pron i es are developed for specific types of 
implemented steps of: events. 

receiving requests from a plurality of clients for a given 14. The computer program product as recited in claim 13, 

program, said requests including a client profile for wherein the specific type of event is a sporting event, 

each of the respective clients; 15. The computer program product as recited in claim 13, 

from a plurality of related streams, selecting streams to 25 wherein the specific type of event is a concert. 

send to each respective client based on the respective 16. The computer program product as recited in claim 13, 

client profile to form selected streams; and wherein the specific type of event is a movie. 

sending each respective client only respective selected 17. A system for providing a tailored content stream to 

streams for the client; respective clients from a server, comprising: 

wherein the step of generating the client profile comprises means for generating a client profile for each of the 

the steps of: respective clients; 

gathering inputs from a user at a client for a selected set means, from a plurality of related streams, for selecting 

of streams; streams to send to each respective client based on the 

sending the inputs to the server; and 35 respective client profile to form selected streams; and 

deriving a filter from the set of inputs; means for sending each respective client only respective 

wherein a client profile for a client developed for a prior selected streams for the client; 

event is used to filter streams for a new event until new wherein the means for generating the client profile corn- 
inputs from the client indicate changes to the client prises: 

profile are desired. 40 means for gathering inputs from a user at a client for a 

2. The method as recited in claim 1, wherein the client selected set of streams; 

profile is derived at least in part according to client charac- means for sending the inputs to the server; and 

teristics. means for deriving a filter from the set of inputs; 

3. The method as recited in claim 2, wherein the client wherein a client profile for a client developed for a prior 
characteristics comprises location. 45 event i s used to filter streams for a new event until new 

4. The method as recited in claim 2, wherein the client mputs f rom tne c ii ent indicate changes to the client 
characteristics comprises machine capabilities of the client. profile are desired. 

5. The method as recited in claim 1, wherein client \$ xh e system as recited in claim 17, wherein the client 
profiles are developed for specific types of events. pron le is derived at least in part according to client charac- 

6. The method as recited in claim 5, wherein the specific 50 teristics. 

type of event is a sporting event. 19. The system as recited in claim 18, wherein the client 

7. The method as recited in claim 5, wherein the specific characteristics comprises location. 

type of event is a concert. 20. The system as recited in claim 18, wherein the client 

8. The method as recited in claim 5, wherein the specific characteristics comprises machine capabilities of the client, 
type of event is a movie. 55 21. The system as recited in claim 17, wherein client 

9. A computer program product in computer readable profiles are developed for specific types of events, 
media for use in a data processing system for providing a 22. The system as recited in claim 21, wherein the specific 
tailored content stream to respective clients from a server, type of event is a sporting event. 

the computer program product comprising: 23. The system as recited in claim 21, wherein the specific 

first instructions for generating a client profile for each of 60 type of event is a concert. 

the respective clients; 24. The system as recited in claim 21, wherein the specific 

second instructions, from a plurality of related streams, type of event is a movie. 

for selecting streams to send to each respective client 25. A method in a data processing system for customizing 

based on the respective client profile to form selected content, the method comprising the dat processing system 

streams; and 65 implemented steps of: 

third instructions for sending each respective client only obtaining a plurality of profiles for a plurality of clients, 

respective selected streams for the client wherein each profile within the plurality of profiles is 
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an associated profile associated with a client within the 
plurality of clients and includes preferences for the 
client; 

selecting data streams for each client within the plurality 
of clients based on an associated profile and client 5 
geographic position data to form a set of customized 
content for the plurality of clients, wherein the client 
geographic position data is obtained from a positioning 
system associated with the client; and 

sending the set of customized content to the plurality of 10 
clients, wherein customized content is for an event and 
wherein the steps of obtaining, selecting, and sending 
are performed periodically such that presentation of the 
event is customized during presentation of the event in 
response to changes in the plurality of profiles. 

26. The method of claim 25, wherein the preferences 
include user selections of data streams. 

27. The method of claim 25, wherein the event is a 
sporting event. 

28. The method of claim 25, wherein each profile within 20 
the plurality of profiles includes a location of a client. 

29. The method of claim 25, wherein each profile within 
the plurality of profiles includes a configuration of a client. 

30. A method for providing a tailored content stream to 
respective clients from a server comprising the computer 25 
implemented steps of: 

generating a client profile for each of the respective 
clients; 

from a plurality of related streams, selecting streams to 30 
send to each respective client based on the respective 
client profile and client geographic position data to 
form selected streams, wherein the client geographic 
position data is obtained from a positioning system 
associated with the client; and 35 

sending each respective client only respective selected 
streams for the client, wherein customized content is 
for an event and wherein the steps of obtaining, 
selecting, and sending are performed periodically such 
that presentation of the event is customized during 40 
presentation of the event in response to changes in the 
plurality of profiles. 

31. The method as recited in claim 30, wherein the step of 
generating the client profile comprises the steps of: 

gathering inputs from a user at a client for a selected set 45 

of streams; 
sending the inputs to the server; and 
deriving a filter from the set of inputs. 

32. A computer program product in computer readable 5Q 
media for use in a data processing system for customizing 
content, the computer program product comprising: 

obtaining a plurality of profiles for a plurality of clients, 
wherein each profile within the plurality of profiles is 
an associated profile associated with a client within the 55 
plurality of clients and includes preferences for the 
client; 
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selecting data streams for each client within the plurality 
of clients based on an associated profile and client 
geographic position data to form a set of customized 
content for the plurality of clients, wherein the client 
geographic position dat is obtained from a positioning 
system associated with the client; and 

sending the set of customized content to the plurality of 
clients, wherein customized content is for an event and 
wherein the steps of obtaining, selecting, and sending 
are performed periodically such that presentation of the 
event is customized during presentation of the event in 
response to changes in the plurality of profiles. 

33. A data processing system for customizing content, 
comprising: 

means for obtaining a plurality of profiles for a plurality 
of clients, wherein each profile within the plurality of 
profiles is an associated profile associated with a client 
within the plurality of clients and includes preferences 
for the client; 

means for selecting data streams for each client within the 
plurality of clients based on an associated profile and 
client geographic position data to form a set of cus- 
tomized content for the plurality of clients, wherein the 
client geographic position data is obtained from a 
positioning system associated with the client; and 

means for sending the set of customized content to the 
plurality of clients, wherein customized content is for 
an event and wherein the steps of obtaining, selecting, 
and sending are performed periodically such that pre- 
sentation of the event is customized during represen- 
tation of the event in response to changes in the 
plurality of profiles. 

34. A data processing system for customizing content, 
comprising: 

means for obtaining a plurality of profiles for a plurality 
of clients, wherein each profile within the plurality of 
profiles is an associated profile associated with a client 
within the plurality of clients and includes preferences 
for the client; 

means for selecting data streams for each client within the 
plurality of clients based on an associated profile and 
client geographic position data to form a set of cus- 
tomized content for the plurality of clients, wherein the 
client geographic position data is obtained from a 
positioning system associated with the client; and 

means for sending the set of customized content to the 
plurality of clients, wherein customized content is for 
an event and wherein the steps of obtaining, selecting, 
and sending are performed periodically such that pre- 
sentation of the event is customized during presentation 
of the event in responsed to changes in the plurality of 
profiles. 
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■ DELIVERING CONTENT BY ENCAPSULATING INTO PACKAGES 

WITH ASSOCIATED META-DATA) 

In one embodiment of the invention, a content is 
composed for delivery over a network to a 
subsystem. The content has a package containing a 
content. The package has package elements. The 
package and the package elements are tagged using 
meta-data. The meta-data are serialized into a 
file system compatible with the subsystem using a 
markup language. 
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i ' &wtstw (8) 

^ f ^ ^ i(coinposer)212 - *f It 1*3 S # t£ i (packaged 
content tagger)214 - ^#f(^^^^bi216 - £f It j& 
!S212#*#r»&#i#ft2g:^/fc° ^ It 1*3 ^ # 12. fi 2 1 4 £S i& 

# «t 4a *f M M It 7t # £f & it t # 

7t # -h # *& • #^^^^-fbH216^^#^i^^a^ii 
Ftt t# -T ^ # # iH 0 

•fete ^ f - a If 2 3 0 f S it f 1 £ I210^ii^f £ 

•it *ft ° fenfaszso^^^^^^^rtigi^i^tii 

H 2 1 0 ffl 7t f f4 • 4t*^*t250«:^-3**a3te. ^ f 

# - ^^^^tm^-^-^^m^L.^ » 4t ft $ *t 2 5 0 «. ^ 1 
it (directories) - -f- S t(subdirectories) |o l-^^t $ 
«t ( f a c i 1 i t i e s ) a «. #>J ft fit f> Jl ° 

M3^*4jt^«-W-JLft1T«fe frJ ' m #4 ^ *° Hi 2 #r 7F *t it 
^ /& §§ 2 1 2 4l #J m " iff ^i^212&^fef i 
(collector)310 ^ li ,^ ff(organizer)330 ° 

^ # H 3 1 0 «fc # #L I: *t30 t t ^(post- 
production site) w I i *f t 3 2 0 • « HI3()T « & # 
«q H ft <£3 2 > #^.^1 ^34 - m j& f*3 ^36 - *° £ *h 
«P « *. * 3 8 0 t(HTML) « 

K > MP 3 QuickTime 1 f$ * i$. >b & > i& ft £• -to 

^ # ft S- 0 ft ^ ^ f ^ i ^ t ^ if « ^ >f ^ S ^ * 
(originator) & ft ?£ % ^(aggregator) #l & <f % m ^ 
^^■^ft^Si^^^^i^ f (nature) » 

*g.J*SS330JMP#f«&#*] #j ft 2& *f *f It 3 2 0 & $, j& N M M It 




i - (9) 

% # 3 3 5 t $'] 3 3 5 N ° # -flS £f it to # 3 3 5 k $t J& - 48 ft 
& o ^ . M j£ it #33 5! M M $'JMP3 > £f it it # 3 3 5 2 « 
*f ^ 5 'J HTML m 1 - *f It 7t #33 5 3 i-X if j& fj ^ - -flSHTML m 
I # • .ta ,^ i 33 0 t ^ - °l - ^ t S f « M f it # 
33 5i £>] 335 N - is. m If 3 3 0 it J* ft # 2 5 0 ( ffl 2 ) X $fr a m M 

(script) - »T lifi- ^ ^(executables) ^^^f^^5!|Mj 

a #/ a n. ° 

m 4 & m. * % w - a it ir «fe ' #r it ®2 #t m $l 

« ^Ht* g2144L*.J | - £f & ft g. # 7F H 2 1 4 & # 7G # # 

H410 - £f it 7b # *f- & H (grouper)450 - £f it # tf H 4 7 0 - 
7tt#430 - *o it it t£ St H (marker) 490 - 

7b # # 7F 33 4 1 0 M & & 7F H 4 70 * tc t #43 0 -fr # a ^ 
#3N-^it7b#33 5 1 £j 33 5 K *"£t&320#«ie, • tg # # tf If 
4 1 0 4£ tl t # 4 3 0 ^ £ £Mi # #1 £f It it # ° 

7b**H30#^&^#^#t£320 &te#t&&#i£8 ° *f 
*f it tc # #j # IE. & & it # ^ m m *&4 3 2 > 7b#ftl#ts 
434 - i^^^"^^fi436 - rt&i&#§(expiration)#*& 
438 - 1*3 #l&440 - J^^i^ it (filtering) #te. 442 - 

& # la 4 4 4 ' 1® A 4b (personalization) # *£ 446 - £f 
It 3 2 0 #j # la & ^ it 1$ #J # l& 4 4 8 ° 7b#^IH^t&432^ 
*f it tc # # £ $| 0 tc # >& i # fa 4 3 4 a - # fit & £ A -fit 
£ ft 1& £ ' #7F#it7t#:ifr*titrt6<j'ffc4. ° >J -k° ' tc # -fit 
f. # la 4 3 4 a h Jg, M 4Sl *h ( a b s o 1 u t e address) * *s Stf 45l 
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i > (10) 

^(relative address) > & k% % 'I *f M M $L to # #j ft - ft 
S ^ ft te.4 3 6 M 4£ # M ^ H: *f ^ £J *f & to # #J ft ^ ^ 

ft s- & ^ ^ f tfi ° t m a a & m m n > url > ^ ^ s m 
m " ft s i§ ^ # te.438 & 7Fi*i&ifcm&- + ¥}!k.^m 

( 1 i f et ime) • ft S- M, $L ft te.4 4 0 & # & -f- % & t #J £ ^ 51 
f (presentation engine) iM£ A3 a S. t ^ ^ t fl? 4f #J & 
«t ° ft S i§ jft * te.442 7F ft M n. ft & ^ m i§ ift ° 
ft ^i&jft#te.442"5T«ffl ^ #t ffi ^ bb #f ( s i mp 1 e matching) 
$>] fa M it *K cor re 1 at ion match ing) ¥j & % 
(heuristics) • £ ft tL 44 4 ffi ^ ^ £f It tc # ^ 4b 
^ -f- £ i7 0 ft A 4b ft I&44 6 #: ffi & ^ & & -f- £ *fc -h 

*r til m % m ft i§ 2ft S. j& ( p r e s e n t a t i o n ) 4@ A 4b -AH A 

-S- - m $l n m ft te>448 & m & m m m & m $l n # 

£f JR. it # # & H 4 5 0 JMF ft l& £f It 7t # # & ;& & ^ * #• « 
it ^(grouped tagged package elements)455 ° 

m ^ m m 4i o a n m & m m & m m $l32q • & 

#^SS490«^#ia^^|ta&^-itA*i»*#i^6<j*fiR 
ft — ^ » «t f'l ( P 1 a y 1 i s t ) 4 9 5 - 

m 5 %, m. ijt * # a ^ - * it * «fe #j > ^^7F*»B2^^ ^ ^ 

ft^^^bH216^^ISI « # f i216 I E i 

(representer)510 > Jfl*(schema)530 - & % 
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3. - %rWf?LW (11) 
( t r an s f o r m e r ) 5 5 0 ° 

JL $t H 5 1 0 n H & 3 2 0 4£ ffl m ^- 5 3 0 *l $L ft & tt M 
& ffi it ° #3-g-530H.^J.3^ffi i# 3? # (framework) - 
itfc ' m %r 5 3 0 #c 46 - # it m # ^ & t& ' 13 ft # it ^ *f & 

m. ^ iH t ' #9#530J^4I.^TJ€ilW*»*tlr(extensible 
markup language, XML) ° E % 3§ 5 1 0 A ± m fa W- f it # 
5 1 5 , £J 5 1 5 N it 3. m fa tf t it & 5 1 8 $r #J jtf M £J it # # tL 4 1 5 , 

$-J415 N sfo *fr & # !i47 5 - 

# & H 5 5 0 fft fa tf •§ it #- 5 1 5i $•] 5 1 5 N - m fa tt t M %L 

5 1 8 M $L 3 2 0 & afc PI 4 9 5 # #r # £f «. it # 3 3 5! M 3 3 5 N 4# %■ 
&-&&3-n&J&&4bM$Lmfan-£Z-£t It J*3 5 5 5 • # 

50^#i€^^f^^27(ffill) ° # it ^ J£ ft 2 7 |& 4# f£ £ 
,^2 50 ( 8 2 ) * ^ > £■ # # Ml * % 5 0 # t% f& % & ft • 

ii 6 h ft % w - * xt * #i ' m TP *» iu^f^ t 

6 10 ^ ft H it t # 6 1 8 > ffl # «t ^ 6 1 5 - * H & J* H 
6 3 0 - ifc^f a 8 6 5 0 > #»ft«lfcg:»£**k660 - 

ft fi ® 6 1 0 & ijfc # ^ M & J*3 S 2 7 it J. ft -f£ A ft 
g«.ffl*«t^6156<i-^fli5t^A*#*.^*f(parse)#ia 
if It ft S- 2 7 • ft H ft © 6 1 0 ^ £k m ft >fc H it t # 6 1 8 # 
f £. # it *f ^ ^ £. 2 7 • # H ^> ® 6 1 0 ^ ^ a ft # ^ 1 ffl 
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# f§ &l $ H 6 3 0 a & #■ & If fl? * * *&660 &l#!S&&3£ 

*t it 6 2 o - G5Q&&&>&nm.m t n$3Q ft 

& m t e. -It it • f^^f si650t^e,M^^f 

ft tt. is it % m- • «L4ite*^A#*^«t^ftib*titrt^ ' £f 
^ ^ % ^ a 4- m 7F ^ ft f 1& m & it . a # a sfe jl 

* *S a PfL £ # * A *- » # • SH- & & # ^^T^SltlAi 
fll II ft 7F ^ It * #J ^ # * 4th A It * #J 4L ^ « 

- $F * * Jb ^ ^ # ^ # # £ S ^ ft • 
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" $5fe 90111454 ?±%-6 ft 4® f£ 

fa i & ia - ?t ft & m U * ft S- 4& # # f a * ft s. a # 

4£ - 5£ i& 2* « S& - -f- £ # 12, > i A lb # !£ a t - • 
8 . f tf -f- M $1 ® % 1 Jl # ^ * ' * t t* # ?'J 4b & & - 

mm£m.&j?i-t&*>M$Ln&j& n m m & m % & m m & 
ft s ° 

9 . ^ t tt * m $i ® % 8 m # if & ' * tit^itf 
3- & ^ : 

«. ffl *r % m fa tt tr ( x m l ) m # si ?t t ft ° 

10. — m ft « it sfi *l j& # it — ft S- ^ ' & ^ : 

n ' m m ^ ^ % m m m ft & & M $L ft ft ; 

«. 4dt - «fc n * & ^&^te,4s^^f^f ° 
i i . -kp t tt # #<j n si ^ i o m #j & • ittls^ • 

^ ^ ti ^ f ^ « ^ ?i # f it # ; #n 
to t m « # It # - 

1 2 . 4* t tt -f- *»j m s n 1 1 m & * & ' • 

* it t *4 ^ ffi * fit ^ 4§ BE, • 

13. - « m m m. & & <& - & ^ = 

- i- t t lit ^ t ^ a t ^ I i t ffl ' «* € 

^ A JL A * # : 

% m tf m. & ^ » # ^ ^ - e> *f *. w ft s » % u & & m 
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^ ,f --kk 90111454 ?cZ%- 6 n 

t ii t tf ^ ^ ^ ' % tit n ft it ¥r & # te. m m f ^ ^ f it 
€ j» *r ^ & m • # i£ ffi p# ^ n t ^ ^ ?>j ^ it t # ^ - 

*a S- ^ t£ -f- % &t tf) % % ft • 

1 4 . t tt # f -j m n 1 3 m & t m m. a a. & » * t ffl ^ 
^ *t ^ ^ ^ & >itf#fit#^^^^ti^rti^^ 

J» t£ M $L 7t # & A & - ft. 4f * #j t f* ^ ^ fll ° 

> # li ^ I ^ ^ - #. ^ £ i*j s- - ^ ^ «p « 

s- * t ^ - ° 

i 6 . t tt * #j m s ^ 1 5 m & € m m a a & • t f*j 

* ^ ^ - if # * ®? * ^ f i t^ - ° 

i 7 . 4o t tt # #j ft si % 1 4 is # % m m. A m. & ' % t ffi « 

ft. # 4l « « "ST ft ^ ^ 31 & ^ : 

1 1 ^ ^ o 

1 8 . 4n t tf -f- #'J II K Jjl 1 3 jJ! #j % m m. A A & ' % t ffl « 

#s ^ - 4n it #■ # * e, ^ #■ m m it # # € j» *r it m A m ; 

* m it # # te. w *f ^ it # # ie ^ % m it m A m ; 
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» « ^ «. «t fa «; « & ^ ^ » at *i # € j» *r it m ^ «i ° 

1 9 . t f* # *«j m m % 1 8 ji # € js m ^ j. a - * t n ft 
ft m it & ?t & % m - ft ft % n # * a - ft ^ & * # 

fa - ft 31 # is > ft it & # fa - £ # fa » a 4b # 
ta t ^ — ° 

20.*»t**3Miaffl^l33j|6<i«J«3&^,J.iS. ' * t ffl « 
?>J 4b 4l € li T ft m & *l & & ' 

itL m & m fa n t # m # & % ft it # ^ € m «r ft ^ 

W #r 3. it t i& M & ft & & M M tff « * * Ifc # *f 

H ft s- 4l t ft m. & m ° 

2 1 . t ft # *'J II IS * 2 0 Jg S*j t JBi ^ 5*. J. A ' * t ffl « 

t i ^ # p# ^ tt -r ( xml ) *g # ^ $i ft tf f4 4l t jk »r 
tt ^. ^ m ° 

2 2. - tttftft^ift ' & ^ : 

- * * t jg. ^ m ft «. ^ it m m n ^ m m a- » f £ € is 
a s£ j. 0 ° D * # : 

^. S ^. # i£ -5- % fSL it 5& m 3& ft # i£ #J *f «. ft ^- - m M %L 
^ ^ I- t J-X ft ffl Rt^ tl f &ij I it f t4 f a §(j # f - f£ M 

&A%teMfcft&ttM£ftft^%m^ikm-£<m l ; ^ 
«. ft ^ s 4t t^itiia^^ita^^w^wtft^ ft 
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: " 90111454 a UL£ 

2 3 . -ko t * M la HI ^ 2 2 ^ « li m A M. £> ' £ t ffl J-X 

4 j£ ^ t m t* ^ ^ m, & ^ : 

2 4 . ^ t tf || ® % 2 3 #j % m m A fk £> > t ffl « 

# # € * T tf ^ ^ 4| & ^ : 

#f ft 't Pc H in m ik %l m ° 

25. - ^ m u m n. - ft & « it m. m # m. ^ % &t » a 

- 4t # lit ; 

- a f s tfe u*. te. -It li ^ -f J£ if ; 
-H^£tt^f«gat34«*^|il - M $L ft & - 

T%m,&)M%Lft&&m.M&. > i%iLM$Lft&&m.miiL& 

- # t e. n ^ *r & *o & ffl it t # ^ 

£f H 7G #■ #t # Id > 

- % n -fb it ' ifo ^ 5. t£ # i5 n a *i ffl - m ijo %% t m n ft 

* & n* n -ft & - « & g. 6d # & ° 

2 6 . *» t # * M ie, S * 2 5 * 6<j jfc ft ' Itl^lS^ 
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2 7 . 4* t tf * #<J £ SI % 2 6 Jjt tf] % tit » I t ^ i i if ^ « 
Irtl: - #1 if I $ - jk *l n % - ***h*PftS£-t4L 

2 8 . 4* t tf #ij |E SI $ 2 7 JJt ft $ & • 

-fc-ttlftJWii#£#'fH*f&7t# ; ii 3- n # l£ *f & it # 

30.*»t^*#!ll&SI*25^6<j^«, ' £■ t « Id H & ^ : 

- it # m it H ' a j«p it #■ ft Id & t^#i^fic# ; 

- it # # i ' ^ ^ i. it ^ # l£ i a ^ # ^ *f ^ it # ft 

I £ * t£ £f JR. it # # & — Ml > 

- *r jr ft it m ' « 1 1 # .ii ^ # t ^ # - m jr ft tt a 

;& it IT &■ ^ it # ft it & $L & - M JR. : A 

- -fef JR I & Sfc ii ' fa&$-i&M$L&izn « *fr ** *f JR «. Id Sfe 

& ^ m & h ° 

3 1 . ^ t If * ® $ 3 0 3g #j & #c. ' t l£ it # ft Id & 
to # 4fc £ ft *S » it # ;& & ft Id - ft ^ 7& ^ ft Id - ft 

^ m it - ft m : M ft ie. * ^ & ft id - n a i a 4 t ^ 

3 2 . 4o t If * *'J 4£ SI J£ 2 5 *1 #j $ #. ' * til 4b H 
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3 4. — m M a it ifi ^ # it - ft S- 4L $ ft ' & ^ : 
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3 5 . *d t n 4- #'J fa SI % 3 4 ^ ^ % #L » * t # li -fr © & 
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